Papers by Nicholas C. Jacobson
LENS: LLM-Enabled Narrative Synthesis for Mental Health by Aligning Multimodal Sensing with Language Models (2026.acl-long)
Copied to clipboard
Wenxuan Xu, Arvind Pillai, Subigya Nepal, Amanda C. Collins, Daniel M Mackin, Michael V. Heinz, Tess Z Griffin, Nicholas C. Jacobson, Andrew Campbell
| Challenge: | Current LLMs cannot natively ingest long-duration sensor streams and paired sensor–text datasets are scarce. |
| Approach: | They propose a framework that aligns multimodal sensing data with language models to generate clinically grounded mental-health narratives. |
| Outcome: | The proposed framework outperforms baselines on NLP metrics and task-specific measures of symptom severity and clinically meaningful narratives. |